Data-Driven Estimation of Capacity Upper Bounds
نویسندگان
چکیده
We consider the problem of estimating an upper bound on capacity a memoryless channel with unknown law and continuous output alphabet. A novel data-driven algorithm is proposed that exploits dual representation where maximization over input distribution replaced minimization reference output. To efficiently compute required divergence between conditional distribution, we use modified mutual information neural estimator takes as additional parameter. numerically evaluate our approach different channels show empirically estimated bounds closely converge either to or best-known lower bounds.
منابع مشابه
Capacity upper bounds for deletion-type channels
We develop a systematic approach, based on convex programming and real analysis, for obtaining upper bounds on the capacity of the binary deletion channel and, more generally, channels with i.i.d. insertions and deletions. Other than the classical deletion channel, we give a special attention to the Poisson-repeat channel introduced by Mitzenmacher and Drinea (IEEE Transactions on Information T...
متن کاملCapacity Upper Bounds on Binary Deletion Channels
In this paper, we discuss the problem of bounding the capacity of binary deletion channels in light of the paper, “Tight Asymptotic Bounds for the Deletion Channel with Small Deletion Probabilities” (Kalai, Mitzenmacher, Sudan, 2010), which proves an upper bound of C ≤ 1 − (1 − o(1))H(p) for the capacity of a binary deletion channel for p approaching 0. We present a brief history surrounding th...
متن کاملOn Theoretical Upper Bounds for Routing Estimation
Routing space estimation plays a crucial role in design automation of digital systems. We investigate the problem of estimating upper bounds for global routing of two-terminal nets in two-dimensional arrays. We show the soundness of the bounds for both wiring space and total wire-length estimation.
متن کاملComputation of upper-bounds for island-driven stochastic parsers
A theoretical framework has been introduced for the computation of syntactic upper-bounds for partial analyses obtained by an island-driven parser. Several proposals have been advanced in the ASR literature for the use of Alike algorithms, based on the computation of acoustical upper-bounds. Syntactic upper-bounds can be integrated with the acoustical ones to drive the search process toward bot...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Communications Letters
سال: 2022
ISSN: ['1558-2558', '1089-7798', '2373-7891']
DOI: https://doi.org/10.1109/lcomm.2022.3207385